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(54) Moving object and transient event detection using rotation strip aperture Image 
measurements 



(57) A spinning aperture imaging radiometer sensor 
system (10) and data processing methods (20) for 
detecting moving objects derived from a plurality of 
Image frames acquired by a strip aperture imaging sen- 
sor. A moving object in any invididual image frame 
results in a motion smear signature in the total synthe- 
sized image. The motion smear signature is processed 
to detect the moving objects. One embodiment of the 
system comprises a rotating strip aperture telescope 
(1 1), a two dimensional detector array (17) that detects 
images in the telescope's focal plane, a rotation com- 
pensation device (19) that prevents rotational smear 
during integration time of detectors of the an'ay. a signal 
processor (18) that records a plurality of image frames 
of a scene imaged by the telescope as it rotates around 
its optical axis, and that implements method(s) (20) for 
detecting the moving objects present in tiie recorded 
images. A hierarchy of moving object detection proces- 
sors (18) and metiiods (20) is disclosed that includes 
spatial, temporal, spatial frequency, and temporal fre- 
quency domain detection processors, and Is compatible 
witii multi-spectral background rejection techniques. 
Selection of the appropriate processing procedure and 
method depends upon tiie scenario, and the effective 
signal to noise ratio characteristics of the moving object 
The present Invention may be used for transient event 
detection. 
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Description 
BACKGROUND 

5 The present invention relates generally to spinning aperture radiometers and methods, and more particularly to 
spinning strip (partial) aperture imaging radiometers that synthesize equivalent full circular aperture images and detect 
moving objects from a plurality of rotating strip aperture image, or synthesized image measurements. 

To provide high resolution images from space-based platforms, for example, conventional sensor architectures use 
active control of large, heavy, deployable optical systems. Depending upon the mission requirements and size of the 

10 primary mirror, the active control can range from periodic piston and tilt control of primary min'or segments to piston, tilt, 
figure, and alignment control of all optical elements of the sensor. Full aperture systems with the same resolution as the 
present invention have a great deal of light gathering capability because of ttie relatively targe aperture areas. However 
to place multi-meter diameter apertures into orbit, full aperture systems competing with the present invention require: 
segmented optical surfaces and folded support structures, if the optical system diameters are larger than the launch 

15 vehicle's fairing; complex and potentially high bandwidth adaptive optical techniques, If thin defbrmable mirrors are used 
to save weight; and complex piston and pupil matching conti'ol, if Implemented as a phased array. Therefore, full aper- 
ture systems are relatively heavy and have high technical risk when compared to the present Invention. 

The processors artd methods described herein relate to and provide for an improvement to the system capabilities 
of the closest prior art, preferred to herein as SpinAp- The SpinAp system and processing method is described in U.S. 

20 Patent No. 5,243.351, entitled "Full Aperture Image synthesis Using Rotating Strip Aperture Image Measurements", 
which is assigned to the assignee of the present invention. 

SpinAp is a sensor system and data processing method that is capable of synthesizing images having resolution 
equivalent to a full circular aperture. The equivalent SpinAp syntiiesized full circular aperture has a diameter equal to 
the largest correlation length associated with the strip aperture's geometry. To accurately synthesize an equivalent full 

25 aperture image, SpinAp acquires imaging data using the rotating sensor's focal plane detectors at time Intervals appro- 
priate for completely measuring the optical system passband of the equivalent full circular aperture. The images are 
processed by methods described in U.S. Patent No 5,243,351. 

The commonality of the approaches between the SpinAp system and tiie system of the present invention (referred 
to as SpinAp moving object detection) arises from the use of temporally registered strip aperture measurements to syn- 

30 thesize images having resolution equivalent to a full circular aperture. The equivalent SpinAp synthesized full circular 
aperture has a diameter equal to the largest correlation length associated with the strip aperture's geometry. 

To accurately synthesize an equivalent full aperture image, SpinAp acquires imaging data using tiie rotating sen- 
sor's focal plane detectors at time intervals appropriate for completely measuring the optical system passband of the 
equivalent full circular aperture. Tlie images are processed by methods described In U.S. Patent No. 5,243,351. 

35 However, a moving object in the Instantaneous field of view of any of the individual frames will result in a motion 
smear signature In tiie total syntiieslzed image. Detection of the moving object is required to establish object phenom- 
enology, such as, position, size, trajectory, velocity, acceleration, and point of origin. In addition, the detection process 
is a precursor to applying processors and metiiods to the acquired data that permit stationary image synthesis of the 
moving objects. Therefore, a hierarchy of moving object detection processors and methods is described herein. The 

40 hierarchy includes spatial, temporal, spatial frequency, and temporal frequency domain detection processors, which 
may also incorporate multi-spectral background rejection techniques. The present system makes use of the available 
measurements to detect moving objects in tiie f ieW of view of tiie synthesized images, in the field of view of any pair of 
SpinAp individual frames, in any one of the SpinAp individual frames, or any combination. The same methods may also 
be applied to transient event detection. 

45 Therefore, It would be an advantage to have modified SpinAp image processing metiiods that woukj result in lower 
paytoad weight for a given effective syntiieslzed aperture size, while providing capability to detect moving objects in tiie 
sensor's field of view. Furthermore, It would also be advantageous to have a system having image processing and mov- 
ing object detection methods that provide a lower risk, lower cost, lighter weight, and simpler fabrication deployment 
alternatives to deploying complex, large full circular apertures (or phased array telescopes) requiring complex adaptive 

50 optical systems for space based imaging applications. 

SUMMARY OF THE INVENTION 

To meet the above and other objectives, one embodiment of the present Invention provkies for a spinning strip radl- 
55 ometer imaging and detection system that is capable of detecting moving objects. The system includes a rotating strip 
aperture telescope that produces temporally contiguous or sequential Images. The rotating strip aperture telescope 
typically comprises a rotating strip aperture primary reflector and a secondary reflector. A two dimensional detector 
array is provided to detect images located In the focal plane of tiie telescope. A rotation compensation device Is 
employed to prevent rotational smear during the integration time of tiie detectors of the array A signal processor is pro- 
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vided for recording a plurality of image frames of a target scene imaged by the telescope as the strip aperture rotates 
around the optical axis of the telescope, for synthesizing the equivalent full circular aperture image, and for detecting 
moving objects in the individual strip aperture frames, any pair of frames, the synthesized image, or any combination of 
individual frames and synthesized images. 
5 The present invention thus provides for a spinning strip (partial) aperture imaging system that synthesizes equiva- 
lent full circular aperture images, and detects moving objects in the sensors field of view from a plurality of rotating strip 
aperture image measurements, while conpensating for random, and/or systematic line of sight errors between individ- 
ual strip aperture images. The present invention thus provides improved total system performance when compared to 
the SpinAp system of U.S. Patent No. 5,243,351 by providing means to synthesize an equivalent full circular image, and 
10 simultaneously providing the capability to detect moving objects. 

Example embodiments of SpinAp moving object detection methods are described below. Since each embodiment 
of the radiometer system, image synthesis, and nnoving object detection processing method depends upon specific 
mission requirements and engineering tradeoffs, the radiometer system, image synthesis, and moving object detection 
method incorporates means to conrpensate for random, and/or systematic line of sight drift between frames, and a 
75 priori and a posteriori known error sources, such as, non-isoplanatic optical system point spread functions, field point 
independent image smear due to image motion and finite electronic bandwidth of the detectors, and field point depend- 
ent image smear caused by uncompensated rotational motion of the image. 

Embodiments of the image synthesis and detection process performed by the present invention summarized above 
are as follows. As the spinning strip aperture rotates around the telescope's optical axis the following occurs. The rota- 
te tion compensation de/ice counter-rotates during tiie detector integration time, tiiereby providing a temporally stationary 
image. An image frame is recorded and saved. If a rotating (relative to the scene) detector array architecture has been 
selected, the acquired frame is coordinate transformed and interpolated to a reference grid of the synthesized image. 
The data is Fourier transformed and stored. A new frame is recorded and saved. , 

An estimate of the frame-to-frame misregistration of the recorded data due to random line of sight errors is 
25 obtained. The strip aperture images, or the Fourier transforms, are corrected for tiieir line of sight errors and are stored. 
The preceding steps are sequentially repeated for each strip aperture image frame, or the frames are sequentially 
acquired and stored, and then global estin^tes of the line of sight errors are determined and used to register the 
frames. Once any pair, or combination of pairs, of the individual strip aperture images have been corrected for the line 
of sight enters, tiie SpinAp moving object detection process may begin. In addition, once a sufficient number (as 
30 described in U.S. Patent No. 5,243,351) of strip aperture image measurements have been acquired the image synthe- 
sis process may begin. The SpinAp moving object detection method may be performed on two, or more, syntiiesized 
images. 

An embodiment of tiie SpinAp nnoving object detection method using two or more synthesized images acquired by 
obsen^ing tiie same scene spatially registers the synthesized images (if required due to line of sight en^ors between 
35 measurement sets), differences all possible distinct pairs of syntiiesized images, sums tiie differenced images, and 
passes the resulting differenced and summed data through a matched filter array and then a comparator. A moving 
object detection is declared when any of the outputs from the matched filter array exceed tiie predetermined thresholds 
of the comparator. 

Anotiier embodiment of the SpinAp proving object detection method using two or more individual line of sight cor- 

40 rected frames resulting from tiie observation of the same scene applies a system transfer function (STF) equalization 
filter to the individual frames to be differenced, differences any or all distinct pairs of equalized frames, and applies a 
non-common passband rejection filter to tiie resulting differenced data. The resulting filtered and differenced data are 
combined by addition to form tiie total summed spectrum of filtered differences. The summed spectra are inverse trans- 
formed, thereby providing a moving object signature in the spatial domain, which is t'ansf erred to a noise optimal 

45 matched filter array and a comparator. A moving object detection is declared when any of the outputs from the matched 
filter array exceed the predetermined thresholds of the comparator. 

The noise optimal matched filter detection processor incorporates properties corresponding to the physical phe- 
nomenology of potential objects, such as, shape, size, velocity, acceleration, background to object contrast ratio, signal 
to noise ratio, number of objects, number of t'ack crossings, and tiie like. The matched filter detection processor also 

50 incorporates a priori knowledge of the measurement noise statistics propagated tiirough the equalization, differencing, 
and filtering process, as well as the unique signal measurement characteristics of tiie SpinAp sensor system. 

The equalization, differencing, and filtering operations associated witii the present invention eliminate all temporally 
stationary components in a common overlap passband of tiie individual frame images, as well as the syntiiesized 
images, leaving only a noisy signature of smeared moving objects. The performance of tiie moving object detection 

55 techniques is scenario dependent and is degraded by individual frame measurement noise propagated tiirough tiie 
equalization, differencing, and filtering operations, and background leakage due to residual frame to frame, and/or syn- 
thesized image to synthesized image registration error. 

Alternative embodiments of spatial (and spatial frequency) metiiods tiiat are described herein correspond to apply- 
ing optimal matched filters to any of tiie differenced frames, and combining the outputs for all possible frame differ- 
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ences. 

While the previous embodiments are typical of SpinAp temporal domain detection methods, temporal frequency 
domain processes may also be enrtployed. An embodiment of a temporal frequency domain processor utilizes a tempo- 
ral sequence of the spatially registered individual SpinAp strip aperture frames obtained by observations of the same 

5 scene. The spatially registered frames are spatially Fourier transformed to a comnnon spatial frequency grid. The com- 
mon spatial frequency grid is associated with the equivalent full circular aperture SpinAp synthesized spatial frequency 
passband. Any or all possible spatially registered and Fourier transformed individual frame images are temporally Fou- 
rier transformed to produce a data set associating all temporal frequencies with each spatial frequency. To obtain the 
best possible detection performance, the temporal and spatial frequency transformed data set is transferred to a noise 

10 optimal matched filter detection processor. The matched filter detection processor incorporates a priori knowledge of 
the object phenomenology, signal and noise measurement statistics, as well as the unique measurement characteris- 
tics of the SpinAp sensor system. A moving object detection is declared when any of the outputs from the matched filter 
array exceed predetermined thresholds. 

By eliminating the zero temporal frequency, the matched filter Implicitly eliminates all temporally stationary compo- 

15 nents in the transformed time history of the individual frames, thereby leaving only the temporal frequency and spatial 
frequency signature of the moving objects. The performance of the moving object detection technique is scenario 
dependent and is degraded by individual frame measurement noise propagation, and background leakage due to resid- 
ual frame to frame registration en-or. 

If observational parameters permit, acceptable performance may be achieved for less than optimal approaches, 

20 whereby the optimal matched filter an^ay and comparator can be replaced by template matched filters and a compara- 
tor, streak detectors and a comparator, or a simple single pixel or multiple pixel threshold exceedence detection proc- 
essor. In this context the word pixel refers to the spatial, or the spatial frequency element of the two dimensional disaete 
representation of the image, or its transform. 

A hierarchy of moving object detection processors and methods is provided by the present invention. The hierarchy 

25 Includes spatial, temporal, spatial frequency, and temporal frequency domain detection processors, as well as, multi- 
spectral background rejection techniques. Selection of the appropriate processing procedure and method depends 
upon the scenario, and the effective signal to noise ratio characteristics of the moving object. The same methods may 
be applied to transient event detection. 

Given knowledge of the strip aperture's spatial response function, the spatial response function of the detectors of 

30 the array, the noise statistics, and the temporal registrations of each of the recorded strip aperture Images permits mov- 
ing object detection by the sensor system and processing methods. 

BRIEF DESCRIPTION OF THE DRAWINGS 

35 The various features and advantages of the present invention may be more readily understood with reference to 
the following detailed description taken in conjunction with the acconopanying drawings, wherein like reference numer- 
als designate like structural elements, and in which: 

Fig. 1 illustrates a spinning aperture imaging radiometer system employing improved data processing methods in 

40 accordance with the principles of the present invention; 

Fig. 2 illustrates a top level embodiment of a SpinAp moving object detection processing method in accordance 
with the principles of the present invention utilizing a plurality of spatially registered SpinAp synthesized images; 
Fig. 3 illustrates a top level emtxxliment of a SpinAp moving object detection processing method in accordance 
with the principles of the present invention utilizing a plurality of spatially registered, system transfer function equal- 

45 ized individual SpinAp transformed frames; 

Fig. 4 illustrates a top level embodiment of a SpinAp moving object detection processing method in accordance 
with the principles of the present invention utilizing a plurality of spatially registered, temporal and spatial frequency 
transforms of SpinAp individual frame images; and 

Fig. 5 illustrates a top level embodiment of a SpinAp moving object detection processing method in accordance 
50 with the principles of the present invention utilizing a plurality of spatially registered, system transfer function equal- 
ized, individual SpinAp transformed frames, and sequential difference frame matched filtering. 

DETAILED DESCRIPTION 

55 Referring to the drawing Figures, Rg. 1 illustrates a spinning aperture imaging radiometer system 10 and data 
processing methods 20 (corresponding to the system described in U.S. Patent No. 5.243,351) that is appropriately 
modified using the principles of the present invention. The spinning aperture Imaging radiometer system 10 and data 
processing method 20 provides moving object detection information, and provide the capability to generate equivalent 
full circular imagery, while renwving line of sight jitter and frame registration errors. Therefore, the system 10 and data 
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processing methods 20 described herein provide enhancements to the SpinAp system of U.S. Patent No. 5,243,351. 
The contents of U.S. Patent No. 5,243,351 are incorporated herein by reference in its entirety. 

The spinning aperture imaging radiometer system 10 comprises a rotating strip aperture telescope 1 1 that com- 
prises a primary 12a and a secondary reflector 12b. A tertiary reflector (not shown) may be employed in the telescope 
5 1 1 under certain circumstances. The system 10 is shown in the form of a satellite comprising a stationary section 13 
having earth pointing antenna 13a. The telescope 11 is disposed on a platform 14, to which the stationary section 13 
Is also coupled. The spinning aperture Imaging radiometer system 10 is adapted to record a number of Image frames 
of a target scene imaged by the telescope 1 1 as the primary mirror 12a (comprising a strip aperture 12) rotates around 
the telescope's optical axis. 

10 A line of sight stabilization mirror 15 and an image derotation device 16 are disposed along the optical path of the 
telescope 1 1 that are adapted to stabilize and derotate the image prior to its sensing by a detector an^ay 1 7. The dero- 
tation device 16 counter rotates the image during the integration time of detectors comprising the detector array 17, 
under control of a rotation compensation controller 19. thereby providing a stationary image. The line of sight stabiliza- 
tion mirror 1 5 is used by a line of sight control system (such as may be provided by a signal processor 1 8 or other ded- 

15 icated control system) to remove high bandwidth line of sight errors, as well as line of sight errors due to orbital 
dynamics of the system 10. 

The target scene Is imaged onto the detector array 1 7 located at the focal plane of the telescope 1 1 that is coupled 
to the signal processor 18 that is adapted to process the image frames. Individual image frames are processed and 
combined In the signal processor 18 to synthesize equivalent full circular aperture images. In the present enhanced 

20 moving object detection SpinAp system 10, the signal processor 18 (or an independent processor) is modified accord- 
ing to the methods of the present Invention to provide for moving object detection. Detailed descriptions of the modified 
processing methods are illustrated with reference to Figs. 2-5. 

Rgs. 2-5 illustrate a variety of different embodiments of the sensor system 10 and processing methods 20, 20-2, 
20-3, 20-4 In accordance with the principles of the present invention employed by the spinning aperture radiometer sys- 

25 tem. A particular embodiment is selected based upon tiie observational scenario and timelines, tiie amount of available 
a priori Knowledge, and the available computational throughput of the processing chain. 

Rg. 2 illustrates a top level diagram of a simple SpinAp moving object detection processing method 20 in accord- 
ance with tiie principles of the present invention enployed using an appropriately modified spinning aperture radiome- 
ter system and processing methods described in U.S. Patent No. 5,243,351 . The detection metiiod 20 shown in Fig. 2 

30 employs two or more SpinAp strip aperture image sets tiiat observe the same scene to generate equivalent synthesized 
full circular aperture images 30 of tiie scene in accordance witii U.S. Patent No. 5.243,351. In the presence of line of 
sight registration errors, each of tiie synthesized Images 30 are optin^lly registered spatially by methods described in 
U.S. Patent No. 5.243.351. 

Any, or all, possible distinct pairs of spatially registered synthesized Images 30 are differenced 40 and subsequentiy 
35 added 35 and stored, thereby generating a total sum 45 of differenced synthesized images. If the number of distinct 
syntiiesized images 30 Is N. then the total number of possible distinct differenced synthesized image pairs Is given by 
N(N-1)/2. 

To obtain the best possible detection performance, the resulting sum 45 of differenced syntiiesized images is trans- 
ferred to a noise optimal matched filter detection processor 50. The matched filter detection processor 50 Incorporates 

40 an array of matched filters 55 having properties con-esponding to tiie physical phenomenology of potential objects, such 
as, shape, size, velocity, acceleration, background to object contrast ratio, signal to noise ratio number of objects, 
number of track crossings, and tiie like. The matched filter detection processor 50 also Incorporates a priori knowledge 
of measurement noise statistics propagated tiirough the synthesis and differencing process, as well as, knowledge con- 
cerning the unique signal measurement characteristics of the SpinAp sensor system 10. Each of the matched filters 55 

45 of the detection processor 50 is applied to every pixel location of the total sum 45 of differenced syntiiesized images. 
The output of each matched filter 55 is transferred to a comparator 60 with thresholds set to a predetermined level of 
each matched filter 55. A moving object detection is declared when any of the outputs from the matched filters 55 
exceed tiie predetermined thresholds of the conparator 60. The threshold may be predetermined by a priori assump- 
tions concerning the signal and noise statistics, or by a posteriori assumptions concerning the signal and noise statis- 

50 tics based upon the Individual frame or set of SpinAp frames. 

The differencing operation eliminates all temporally stationary components of the synthesized Image, leaving only 
the signature of smeared synthesized moving objects. The performance of tiie moving object detection processing 
method 20 Is scenario dependent and is degraded by individual frame measurement noise propagated tiirough the syn- 
thesis and differendng operations, and background leakage due to residual frame to frame registration error. If obser- 

55 vation parameters permit, acceptable performance may be achieved for less than optimal approaches, whereby the 
optimal matched filters 55 and the comparator 60 may be replaced by tenplate matched filters and tiie comparator 60, 
streak detectors and tiie comparator 60, or a simple single pixel or multiple pixel threshold exceedence detection proc- 
essor. 

Fig. 3 illustrates a top level embodiment of a SpinAp moving object detection processing method 20-2 in accord- 
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ance with the principles of the present invention eniptoyed using an appropriately niodified spinning aperture radiome- 
ter system and processing methods described in U.S. Patent No. 5,243,351 . The detection method 20-2 shown in Fig. 
3 employs two or more SpinAp strip aperture images 30-2 obtained by observing the same scene, and generated using 
methods described in U.S. Patent No. 5,243,351. In the presence of line of sight registration errors, each of the individ- 

5 ual SpinAp images 30-2 are optimally registered spatially as described in U.S. Patent No. 5.243,351 , and Fourier trans- 
formed to a common spatial frequency coordinate system and grid. Typically, the common spatial frequency grid is 
associated with an equivalent full circular aperture SpinAp synthesized spatial frequency passband. 

Any or all possible distinct pairs of spatially registered and Fourier transformed individual frame images 30-2 are 
multiplied by spatial frequency filters 31 -2 designed to compensate for the temporally varying system transfer functions 

10 associated with each individual frame and resulting from the rotation of the SpinAp sensor system 10. The system 
transfer function compensation may be implemented by one of several methods, including: equalizing each frame to a 
target full circular aperture or other reference system transfer function, equalizing one frame to the system transfer func- 
tion of the frame to be differenced, or deconvolving the system transfer function from both images to be differenced. For 
ideal system transfer functions, and if and only if only frames acquired n radians apart are to be differenced, no system 

75 transfer function equalization is required. 

For a template signal detection approach. SpinAp moving object detection methods 20-2 based upon any one of 
the many possible equalization procedures have unique noise performance characterized by the particular method's 
receiver operating characteristics (ROC). The differences in ROC for signal template approaches are dominated by dif- 
ferent and uncompensated levels of noise ''boosting" or "de-boosting" generated by the equalization process. However. 

20 an appropriately designed noise optimal matched filter approach compensates for the noise characteristics in tiie 
equalization process. 

The equalized individual frames are differenced 40-2. and spatial frequency filtered 41-2 to eliminate non-common 
information outside an overlap passt)and associated with tiie two frames. The spatial frequency filtered frame difference 
is added 35-2 to previous filtered frame differences and stored, thereby generating a total sum 35-2 of differenced spa- 
25 tial frequency filtered Fourier transformed images. If the number of distinct individual frame images is N, then the total 
number of possit^e distinct differenced individual frame image pairs contributing to the sum may be as large as N(N- 

To obtain the best possible detection performance, tiie resulting sum 35-2 of differenced spatial frequency filtered 
transformed images is inverse Fourier transformed 42-2 to obtain a spatial domain image 45-2. which is transferred to 

30 a noise optimal matched filter detection processor 50-2, The matched fitter detection processor 50-2 incorporates an 
array of matched filters 55-2 having properties con'esponding to the physical phenomenology of potential objects, such 
as. shape, size, velocity, acceleration, background to object conf ast ratio, signal to noise ratio, number of objects, 
number of ti'ack crossings, and the like. The matched filter detection processor 50-2 also incorporates a priori knowl- 
edge of the measurement noise statistics propagated through the equalization, differencing, and filtering process, as 

35 well as tiie unique signal measurement characteristics of the SpinAp sensor system 1 0. Each of the matched filters 55- 
2 of the detection processor 50-2 is applied to every pixel location of tiie total sum 35-2 of differenced filtered images. 
The output of each matched filter 55-2 is transfen-ed to a comparator 60-2 with tiiresholds set to a predetermined level 
for each matched filter 55-2. A moving object detection is declared when any of the outputs from the array of matched 
filters 55-2 exceed the predetermined tiiresholds of tiie comparator 60-2. The tiireshokJ may be predetermined by a 

40 priori assumptions concerning tiie signal and noise statistics, or tiie a posteriori assumptions concerning the signal and 
noise statistics based upon the individual frame or set of SpinAp frames. 

The equalization, differencing, and filtering operations eliminate all temporally stationary components in the com- 
mon overlap passband of the individual frame images, leaving only the signature of smeared moving objects. The per- 
formance of the moving object detection processing method 20-2 is scenario dependent and is degraded by individual 

45 frame measurement noise propagated through the equalization, differencing, and filtering operations, and background 
leakage due to residual frame to frame registration error. If observational parameters permit, acceptable performance 
may be achieved for less than optimal approaches, whereby tiie optimal array of matched filters 55-2 and comparator 
60-2 may be replaced by template matched filters and tiie comparator 60-2. sti-eak detectors and the comparator 60-2. 
or a simple single pixel or multiple pixel threshold exceedence detection processor. 

50 Fig. 4 illustrates a top level embodiment of a SpinAp moving object detection processing method 20-3 in accord- 
ance witii the principles of the present invention employing an appropriately modified spinning aperture radiometer sys- 
tem and processing metiiods described in U.S. Patent No. 5,243,351. The detection metiiod 20-3 shown in Fig. 4 
employs a temporal sequence of individual SpinAp strip aperture images 50-3 or sub-images obtained by observing the 
same scene, generated using metiiods described in U.S. Patent No. 5,243.351 . In the presence of line of sight registra- 

55 Won en'ors, each of tiie individual SpinAp images 50-3 are optimally registered spatially by techniques described in U.S. 
Patent No. 5,243,351, and Fourier b'ansformed 51-3 to a common spatial frequency coordinate system and grid, 
thereby producing Fourier ti'ansformed images 52-3. Typically, the common spatial frequency grid is associated witii an 
equivalent full circular aperture SpinAp synthesized spatial frequency passband. Any or all possible spatially registered 
and Fourier transformed individual frame images 52-3 are temporally Fourier transformed 53-3 to produce a data set 
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54-3 associating all temporal frequencies with each spatial frequency. 

To obtain the best possible detection performance, the temporal frequency and spatial frequency transformed data 
set is transferred to a noise optimal matched filter detection processor 55-3. The matched filter detection processor 55- 
3 incorporates an array of matched filters 56-3 having properties corresponding to the physical phenomenology of 

5 potential objects, such as, shape, size, velocity, acceleration, background to object contrast ratio, signal to noise ratio, 
number of ot^jects. number of track crossings, and the like. The matched filter detection processor 55-3 also incorpo- 
rates a priori knowledge of the variation of the system transfer function and other unique measurement characteristics 
associated with the SpinAp sensor system 10, and the measurement signal and noise statistics propagated tiirough the 
measurement and transforming processes. Each matched filter 56-3 of the detection processor 55-3 is applied to the 

10 set 54-3 of tenrporally and spatially transformed data. The output of each matched filter 56-3 is transferred to a conrpa- 
rator 60-3 witii thresholds set to a predetermined level for each matched filter 56-3. A moving object detection is 
declared when any of the outputs from the array of matched filters 56-3 exceed the predetermined thresholds of tiie 
comparator 60-3. The tiireshoki may be predetermined by a priori assumptions concerning the signal and noise statis- 
tics, and/or by a posteriori assumptions concerning the signal and noise statistics based upon the individual frame or 

15 set of SpinAp frames. 

The temporal frequency matched filter 56-3 implicitly eliminates all temporally stationary components in the individ- 
ual frame images, leaving only the temporal and spatial frequency signature of smeared moving objects. The perform- 
ance of the moving object detection processing metiiod 20-3 is scenario dependent and is degraded by individual frame 
measurement noise propagation, and background leakage due to residual frame to frame registration error. If observa- 

20 tional parameters permit, acceptable performance may be achieved for less than optimal approaches, whereby the opti- 
mal array of matched filters 56-3 and comparator 60-3 may be replaced by template matched filters and the comparator 
60-3, or a simple single frequency "pixel" or multiple frequency "pixel" threshold exceedence detection processor. 

Fig. 5 illustrates a top level embodiment of a SpinAp moving object detection processing method 20-4 in accord- 
ance with the principles of the present invention employing an appropriately nrradified spinning aperture radiometer sys- 

25 tem and processing methods described in U.S. Patent No. 5,243,351 . The detection method 20-4 of Fig. 5 employs two 
or more SpinAp strip aperture images 30-4 obtained by observing tiie same scene, generated in accordance with meth- 
ods described in U.S. Patent No. 5.243.351 . In the presence of tine of sight registration errors, each of the individual 
SpinAp images are optimally registered spatially by methods described in U.S. Patent No. 5,243,351 . and Fourier trans- 
formed to a common spatial frequency coordinate system and grid. Typically, the common spatial frequency grid is 

30 associated with tiie equivalent full circular aperture SpinAp synthesized spatial frequency passband. 

Any or all possible distinct pairs of spatially registered and Fourier transformed individual frame images 30-4 are 
multiplied by spatial frequency filters 31-4 designed to compensate for tiie temporally varying system transfer functions 
associated with each individual frame and resulting from tiie rotation of the SpinAp sensor system 10. The system 
transfer function compensation may be implemented by one of several methods, a few examples of which include: 

35 equalizing each frame to a target full circular aperture or other reference system transfer function, equalizing one frame 
to the system transfer function off the frame to be differenced, or deconvolving the system transfer function from both 
images 30-4 to be differenced. For ideal system transfer functions, and if and only if only frames acquired tc radians 
apart are to be differenced, no system transfer function equalization is required. 

The equalized individual frames are differenced 40-4, and spatial frequency filtered 41-4 to eliminate non-common 

40 information outside the overlap passband associated with the two frames. The spatial frequency filtered frame differ- 
ences are inverse Fourier transformed 42-4 producing individual painwise differenced images 45-4. If the number of dis- 
tinct individual frame images is N, tiien tiie total number of possible distinct differenced individual frame image pairs can 
be as large as N(N-1)/2. 

For a template signal detection approach, SpinAp moving object detection methods 20-4 based upon any one of 
45 the many possible equalization procedures have unique noise performance characterized by tiie particular method's 
receiver operating characteristics (ROC). The differences in ROC for signal template approaches are dominated by the 
different and unconpensated levels of noise "boosting" or "de-boosting" generated by the equalization process. How- 
ever, an appropriately designed noise optimal matched filter approach compensates for tiie noise characteristics in tiie 
equalization process. 

50 To obtain the best possible detection performance, the set of differenced spatial frequency filtered transformed 
images 45-4 is transfered to a noise optimal matched filter detection processor 50-4. The matched filter detection proc- 
essor 50-4 incorporates an array of individual pairwise differenced frame matched filters 55^ having properties corre- 
sponding to tiie physical phenomenology of potential objects, such as, shape, size, velocity, acceleration, background 
to object contrast ratio, signal to noise ratio, nuni>er of objects, number off track crossings, and the like. The matched 

55 filter detection processor 50-4 also incorporates a priori knowledge of tiie measurement noise statistics propagated 
through the equalization, differencing, and tittering process, as well as unique signal measurement characteristics of 
the SpinAp sensor system 10. Each of the individual painwse differenced frame matched filters 55-4 of tiie detection 
processor 50-4 is applied to every pixel location for the appropriate frame difference and subsequently summed. The 
output of each object phenomenology total matched filter 56-4 is transferred to a comparator 60-4 with thresholds set 
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to a predetermined level for each of the total matched filters 56-4. A moving object detection is declared when any of 
the outputs from the total matched filter array 55-4 exceed the predetermined thresholds of the comparator 60-4. The 
threshold may be predetermined by a priori assunrptions concerning the signal and noise statistics, or by a posteriori 
assumptions concerning the signal and noise statistics based upon the individual frame or set of SpinAp frames. 

5 The equalization, differencing, and filtering operations eliminate all tenporally stationary components in the com- 
mon overlap passband of the individual frame Images, leaving only the signature of smeared moving objects. The per- 
formance of the moving object detection method 20-4 is scenario dependent and is degraded by individual frame 
measurement noise propagated through the equalization, differencing, and filtering operations, and background leak- 
age due to residual frame to frame registration error. If observational parameters permit, acceptable performance may 

10 be achieved for less than optimal approaches, whereby the optimal array of matched filters 56-4 and comparator 60-4 
may be replaced by template matched filters and the comparator 60-4, streak detectors and the comparator 60-4, or a 
simple single pixel or multiple pixel threshold exceedence detection processor. 

For the purposes of completeness, the formulation of the SpinAp moving object detection processing method 20 is 
as follows. Using the definitions and nomenclature in U.S. Patent No. 5,243,351 , a desaiption of the mathematical foun- 

75 dations of the enhanced moving object detection SpinAp sensor 10 and data processing methods 20. 20-2, 20-3. 20-4 
embodied in the present invention is presented. 

Individual SpinAp noise free measurements will first be discussed. In the absence of noise, the mean number of 
detection electrons produced during the integration time of a detector located at position R acquired during frame time 
tj may be expressed as, 

20 

Os(R,tj)= I d2F6s(F.tj)exp{-2^^F R> , 



25 

where Oq(¥x) is the spatial Fourier transform of the detector output at spatial frequency F and frame time tj. Assuming 
the effective sensor system transfer function is temporally stationary during the detectors integration time AT, the Fou- 
rier transform of the individual frames detected intensity may be expressed as 



30 



35 



Os(F,tj) = lAsWoAfpasSTF(F,tj) -L dtSn(MF,t) , 



where Ias is the intensity spatially averaged over the effective focal plane array area, w o 's the zero spatial frequency 
corrponent of the detector transfer function. Ajp^s is the effective focal plane array area. STF (F.tp is the total sensor 
system transfer function correspond to frame time tj, and s n(MFt) is the normalized spatial Fourier transform of the 
40 geometrical projection of the scene at time t. 

A mathematical representation of a scene and ttie scene's geometrical projection to tiie imaging plane, including 
background, a single nfK)ving object, and scattering component will now be discussed. The intensity emitted from a 
scene containing a single object moving in front (relative to the SpinAp sensor) of a background, and behind transmis- 
sive scattering layers may be expressed as, 

45 

S(r,t) = T(r,t) + B(r,t) - B(F,t)WtWi{r.t) + H(?,t) . 



where T(r,t) is the intensity distribution of the moving object at scene position r and time t, B(r,t) is the intensity distri- 
50 bution of the background at scene position r and time t, H(r,t) is the intensity distribution of transmissive scattering lay- 
ers corresponding to scene position r and time t, and Wjf.t) is the object's inverse silhouette at scene position r and 
time t. The object's inverse silhouette is given by 

W'i{r,t) = { 1 if T(r,t) > 0 and 0 otherwise. 



Subtracting B(r,t)Wt(r.t) in the equation for S(r.t) corresponds to removing the background photons obscured by the 
moving object at scene position r and time t. 
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Therefore, the geometrical projection of the scene's intensity to the focal plane of the SpinAp optical system is rep- 
resented by 

Ig(R) = J-S(R>M,t) = 
-L(TtR>M,t) + B(R>M,t) - B(IVM,i)Wt{RM,i) + H(RM,t)] , 

where M is the magnification of the optical system. Fourier transforming the geometrical projection and applying the 
Fourier transform similarity theorem yields, 

Ig(F) H Fl(lg{R)] = FTj^S(R/M.t)j = S(MF.t) 

or 

Ig(F)=_ 

-L{FT{'ltR/M.t)} + FTjB(R/M.t)} + FT{H(R/M.t)} - FT{B(R/M.t)WT{R;M.t)}) . 

where FT and ^ refer to the Fourier transform operation. Application of the Fourier transform convolution theorem, and 
transforming variables permits the evaluation of FT{B(R/M,t)W j(R/M,t]}/M ^ yielding, 

^FTjB(R/M,t)WT{RyM,t)) = M^j d2F'B(lv(F-F],t)WT{vF ,t) . 



The corresponding geometric projection of the scene spectrum and its zero spatial frequency component are given 

by 

Ig(F) = f(MF,t) + H(Nff ,t) + B(Nff ,t) - M^j d2F'B(\{F-F ItjWi^I^.t) 

and 

Ig(F = 0) = T(MF = 0,t) + HfNff^.t) + B(MF = 0,t) - M^j d^F 'b(m¥ '.tlWilMF ".t) . 

The instantaneous normalized geometrically projected scene spectrum is represented as 

S„(MF.t) = JS£L = ,J^ 
Ig(F = 0) S(MF = 0) 

TtMF.t) + H(\ff .t) + B(Vff .t) - d2F'B(N(F-F].t)WT(lVff .t) 
T(MF = 0,t) + H(\#^,t) + B(MF = 0,t) - M^j d^F 'b(-MF '.tlWilNF ".t) 
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TTie normalized scene spectrum can be decorrposed into two components dominated by the background and fore- 
ground spectrum, and the moving objects contritxjtion to the spectrum, such a representation Is 



where 



S„(MF,t) = B„(MF,t) + AT „(MF.t) 



B„(MF.t) = 
ft(MF.t)-H6(MF.t) 



[fi(MF = i 



, T^MF = O.t) - M2 I d2F B(-F M,t)Wi(F M,t) 
= O.t) + B(MF = O.t)] ) 1 + ^, _ \ ^. _ ; 



H(MF = 0,t) + B(MF=0,t) 



B „{MV,t) is the normalized bacl<ground and foreground component for spatial frequency MF at time t, and 

Af(MF,t) = 



T(MF.t) - d¥BtF-F]M,t)WT(FM,l 



[H(MF = 0,t) + B(MF = 0,t)]h 



T(MF = O.t) - d2F'B(-FM,t)WT{FM.t) 



H(MF = 0,t) + B(MF = 0,t) 



where AT n(^^Ht) is the normalized object's variation from the background arxJ foreground for spatial frequency at time t. 

Normalized background and foreground spectra for a temporally stationary scenes will now be discussed. For 
oljservational scenarios having temporally stationary total background components, the normalized total background 
spectrum, and moving abject variation are 
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Bn(MF.t)s_ 
H(MF.t) + B(MF,t) 



10 



IS 



f(MF = O.t) - M2 j d2FB(-FM,t)WT(FM.t)| 

[h(MF = 0,t) + B(MF = 0,t)l \ 1 + ^ \ ^ ' 

\ H(MF = 0,t) + B(MF = O,t) 

and 

Afn(MF,t)s 
T(MF,t) - d2F B([M(F-F )])WT{F 'M,t) 



20 [h(mf = o)+b(mf = o)]\ 1 



I f(MF = O.t) - d2F'B(-F MjWilF M.t) 



h(mf=o)+b(mf=o) 



zs Moving object and background decoupling will now be discussed. If the number of background photons obscured 
by the moving object is negligible wtien compared to the total number of background photons, then the total background 
and moving object variation normalized spectra can be further simplified, yiekling 

B„(MF,t).B„(MF) = :, "(^^^(^l 



h(mf = o) + b(mf = o) 

and AT n is given by 



35 



T(MF.t) - M2 d^FBjMF-pljwiFM.t' 



^0 iH(MF = 0) + B(MF = 0)J 



Temporal variation of the object and the object's inverse silhouette will now be discussed. The time dependent 
45 motion of the object may be describe by applying a temporal dependent spatial shift to the argument of the objects spa- 
tial intensity distribution. Defining the starting time of the imaging process to be to. the initial object and the object 
inverse silhouette are given by 

To(0 = T(F.to) 

50 

WTo(r) = WT(F.to). 

The motion dependent temporal variations of the object and the object silhouette are given by 

55 T(M) = To(F-fT(t)) 

WT(M) = WTo(f-fT{t)). 

where F-rft) is the vectorial position of the object in the scene coordinates as a function of time, referred to as object 
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track. 

Moving object and inverse silhouette spectra will now be discussed. Applying the Fourier transform shift theorem 
to the moving object and moving object inverse silhouette produces the corresponding spectra, given by 

T(MF,t) = f(MF,to)exp(-27riMF fr{t)) 
= to(lvff)exp(-2jciFR-Ht)) 

WT(MF,t) = WT{MF,to)exp(-27CiMFrT{t)) 
= WTt)(MF)exp(-27tiFRT(t)) 



and 



respectively. 

Moving object variation from background with explicit dependence on the object track will now be discussed. Sub- 
stituting the above equations for t (MF,t) and w-K^Rt) into the expression for the object spectrum variation aT^, yields 



AT„imF-FjJ) = 



T(j(w)exp (-27iiF-RT (t)) - M^j d^F'B{ [m(f-F )] )WTO(FM)exp (-2niF RT(t)) 
[H(l^ = 0) + B(Nff = 0)] 



For constant velocity motion during the detector integration time, the object's vectorial position can be represented 
R ^(t) = vt . where V is the velocity component of the moving object. TTierelbre, the normalized object spectral variation, 
Af„, 

AT„(MF,t) = 

to(Nff)exp(-2raF V(t)) - M?j d^FBMF-fljWTdllvff )exp(-2jtiF-V(t)) 
[H(\ff = 0) + B(Nff = 0' 



Time average individual SpinAp frame spectra will now be discussed. Since the mean detector measurement 
results from a temporal average of the imaged moving object and total background, the time averaged Fourier spectrum 
of the measurement assuming the system transfer function Is constant during the detector integration time is 
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6s(F,tj) = lAsWoAfpasSTF(F,tj) Bn (MF) + -L dtAT „(MF,t) 

= lAsWoAfpasSTFtF,tj)BN(MF) + lAsWoAfpasSTF(F,tj) • 
^ to(N#) ^ sin(KF-VAT)j ,,^,g.^-.^ 
[h(MF = 0) + B(MF = 0)] TtFVAT 

-lAsWoAfpasSTF(F,tj) _ 

. M2 f B(M[F-F])w-nil^) sin (tcF ■VAT)^f .,,,g.^-p 
j [h(MF = 0) + B(MF = 0)] TtFVAT 



TO 



15 



20 



where the time average of the constant velodty motion required integration of the 'track' integral 



I ^ -^.T-r^ exp(-2jtiFVt) -i-^ 
dt exp 2niF V T = — - 



'j-— 



AtJ,.^ exp(-27tiFv) 

, ^sin(7rF-VAT) 
= exp{27tiF Vtj) — ^rz-z 



TtFVAT 

30 The SpinAp synthesizer and synthesizing process will now be discussed. The simplest version of the SpinAp syn- 
thesizing process employs a synthesizer, such that the spatial frequency redundancy average of the noise free meas- 
urements yield the equivalent full circular aperture image, or 



6Fsyn(F)=A(F)6save(F) 

where 6 f syn(H is the full circular aperture image to be synthesized, A (F) is the synthesizer, and where 6 s ave(n 'S 
the spatial frequency redundancy average of the (noise free) individual frame measurement spectra. 

40 



6savc(F) = -lj=rI 6s{f4 



45 



50 



55 



The synthesizer. A, is given by 



.jf) - ^AFAfpaFWoFWNt<F)OTFF(F) ^ lAFAfeaFWoFSTPpiF) 

UsAfpasWos WnsOTFs(F) UsAfpasWosSTFs{F) 



for WfjQOTFs(F) = STFs(F) 9^0. where STF corresponds to the system transfer function, which is the product of the 
optical system transfer function, OTF, the normalized detector transfer function w subscripts S and F desig- 

nate parameters associated with the SpinAp strip aperture sensor and the target full circular aperture system, respec- 
tively The spatial frequency redundancy averaged strip aperture transfer function appearing in the denominator of the 
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synthesizer is 



WnsOTFs(f) = STFs(f) = 

N,i(f) N,r(F) /p \ 

^ X W,s(F.t,)OTFs{F,^ S 
Nr((F)j=i j=, NrKF) 



10 

Therefore, the synthesized image spectrum resulting from the observation of a scene consisting of a temporally 
stationary total background and foreground, and an object moving in the sensors field of view Is given by 



15 



n„(f) 

6Fsyn(F) = A(F)-l=. I Os(F,tj) 
NrKF) j=i 

n„(f) 

= A(F)— L=r2 lAsWoAfpasSTF(F,tj)BN(MF) + 
^ Nrf{F)j=i 

+ m-^''t lAsWoAfpasSTFtF.tj);, "^^^ 



30 



35 



Nr If) j = 1 H(MF = O) + B(MF = 0) 

sinlTcF -VAT) / ^ ' T-n \\ 
TtFVAT 

N,f(F) _ 

-^Pt^ I TAsWoAfpasSTF(F,tj)M2- 

Nrf(F) j=l 

bMf-f])w^MF') sin(;F2v,AT)^^^_^^^^ 
H(MF = 0)+B(MF = 0) kF VjAT 



Further simplification produces. 

40 



45 



SO 



55 



14 



EP0802 426 A2 



10 



Of syn{F) = lAFWoFAfpaFSTFi^F)BN(MF) + 
+ lApWopAf STFfIf) ^ to(MF) ^ 

^ ^'""'Wf) h(mf = o) + b(mf = o) 

S STFs(F.tj) 
j=i 

. "f STFs(F.. r'f:V^'= xi,(-2,i-F-V/.i)). 

j = i 7iF-VjAT 

I STFs(F,tj) 
j = i 

■ H(MF = 0) + B(MF = 0) 7iF VjAT 



20 



25 The first term in the synthesized image spectrum equation corresponds to the equivalent full circular aperture 
image of the temporally stationary background. TTie next two terms in the equation correspond to the moving object's 
signature in the synthesized image. 

Differenced synthesized images and moving object signatures will now be discussed. A moving object spatial fre- 
quency domain signature may be obtained by differencing two or more synthesized image spectra Differencing two 

30 completely independent full aperture synthesized images (or image spectra), while observing the same scene, 
requires a minimum of two 180 degree rotations. Alternatively, to decrease tiie time between frame differences, synthe- 
sized images (or spectra) may be differenced witii as few as one non-common frame, or the synthesis operation may 
be performed with fewer than tiie required number of frames to generate the full circular passband image spectra. 
Since tiie temporally stationary parts of tiie synthesized images are Identical for any pair of synthesized images 

35 observing tiie same scene, the difference of synthesized images will contain only moving object information. The noise 
free spatial frequency domain moving object signature of the differenced synthesized Images Is given by 



40 



45 



50 



55 
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10 



20 



25 



A6BA(F) = 6,y„B(F)-6sy„A(F) 
_ lAFW0FAfpaFSTFF(F) t(i(VDF) 

Nfi(F) _ H(lvff = 0) + B(Nff = 0) 
S STFs(F.tj) 

\ j = i TiF-VjAT 



'5 Nrl(F) 

- X STFs(F,tk)M2 



'j2p' bMf-f])Wtx)(mf) 

h(mf=o) + b(mf = o) 



k= 1 



sin 7iF -VkAT / ^ .^^ • r? / I 
TtF VkAT J 



The spatial signature of the moving object resulting from the difference of synthesized images is 
3^ a6ba(R,5t) = I d2FA6BA(F)exp(27ciF R ), 

where 5T represents the time delay associated with the acquisition of different sets of acquired strip aperture frames. 

35 Differencing any pair of appropriately modified SpinAp frames for bad^round removal and moving object detection 
will now be discussed. For 2Nf individual SpinAp strip aperture frames, there are 2Nf(2Nf * 1)/2 possible distinct painn/ise 
frame comparisons, or differences. An optimal detection technique would take advantage of the background removal 
when differencing any possible pair, as well as. the potentially large number of nxTving object pairwise signatures. How- 
ever, unlike differencing frames for the purposes of background removal and moving object detection for temporally sta- 

40 tionary aperture systems, specific techniques and methods must be applied to the SpinAp data sets to compensate for 
the rotating nature of the system transfer function. The SpinAp data sets are modified to distinguish between temporal 
variations in the scene and temporal variations originating from the moving object. 

SpinAp individual noisy frame measurements and frame to frame system transfer function equalization will now be 
discussed. The individual strip aperture noisy measurements spectra can be represented as the noise free strip aper- 

45 ture detected image spectra plus the strip aperture additive noise spectra 

Osm{F,tj) = Os(Fjj) + ns(F,tj), 

50 where 6 s n & ^i^^ the noise free signal and noise spectra, respectively. 

Individual frame system transfer function passband filter will now be discussed. In general, the individual frame 
measurements provide Information related to different portions of the equivalent full circular aperture optical system 
passband. The detection of temporally nonstationary phenomenology, such as, moving objects or transient events 
requires the identification and utilization of common Information between frames, as well as, accommodating for the dif- 

55 ferences in image contrast due to the time varying nature of the SpinAp sensor's transfer function. The frame to frame 
system transfer function compensation can be implemented by several methods, a few examples of which are equaliz- 
ing each frame to a target full circular aperture or other reference system transfer function; equalizing one frame to the 
system transfer function of the frame to be differenced; deconvolving the system transfer function from both images to 
be differenced; or for ideal system transfer functions, and if only frames acquired n radians apart are to be differenced. 
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no system transfer function equalization is required. 

For a template signal detection approach the SpinAp moving object detection methods based upon any one of the 
many possible equalization procedures would have unique noise performance characterized by the particular method's 
receiver operating characteristics (ROC). The differences in ROC for signal template approaches are dominated by the 
different and uncompensated levels of noise Taoosting" or "de-boosting" generated by the equalization process. How- 
ever, an appropriately designed noise optimal matched filter approach would compensate for the noise characteristics 
in the equalization process. 

While any one of many methods can be used to Implement the system transfer function equalization, the formula- 
tion described in the following paragraphs Is typical of the mathematical details associated with each procedure. For 
brevity, only the procedure whereby one frame is equalized to another is described in detail. 

Selecting one frame as the cun^ent reference frame and any different second frame to be used In the comparison, 
the spectra of the frames are spatial frequency filtered to provide spatial frequency information In the common overlap 
region of the passbands of both frames. The second frame Is also modified to compensate for the differences In system 
transfer function, i.e. 

mR(F,ti) = x(F,tj^(F.ti)6sm(F,ti) = x(F.tiMF.tj(6s(F,tj) + Ss(F.tj)], 

and 

f^lE(F,ti) = x(F,tj^(F,ti)6sai{F.ti)H(F.tj, tj) = 
X(F.tiMF,tji6s(F,tj) + ^s{F,tj)lH(F,tj, ti), 

where m g(F,ti) denotes the spatial frequency filtered output of the reference frame, and m ^(F.tj) the spatial frequency 
filtered and transfer function equalized output of the frame to be compared, X Is the optical system passband filter, 

X(F,tj) = I if STFs(F,tj) > 0, and 0 otherwise 

and H Is the noise free passband equalization fitter 

H(F>ij. ti) = I if cSn!'! > 0' 0 otherwise. 
STFs(F,tj) 



The filtered and equalized difference between any two frames can be expressed as the sum of differenced signal 
and noise spectra, I.e. 

ASiij(F) = mR(F,ti) - fJi^F.tj) = ASij(F) + ANj/F), 



where the differenced, filtered, and equalized noise spectrum, a Ny, is 

ANij(F) = x(F.tjMF,ti)Hs(F.ti) - x(F.ti)J(F.tj)ns(F.tj)Hs(F,tj.ti). 

and the differenced, filtered, and equalized signal spectrum, ASjj(F), is 

ASij(F) = lAsWosAfpasX(F.ti)x{F.tj)STFs(F,tiIsN(M.F,ti)] 
= lAsWosAfpasX(F.ti^(F.tj)STFs(F,ti) • _ 
• [§N(M.F.ti) + TN(M,F.ti) - BN(M.F.tj) - TnIm.F.Ij)]. 
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For temporally stationary backgrounds and foregrounds the resultant signal spectrum is related to tiie difference 
between the normalized moving object variation from the background, AT n. by 

ASij(F) = lAsWosA,p3sX(F.tiMF.tj)STFs(F,ti(ffiM,F.ti) - AtN(M,F.tj)]. 



If the object is moving with constant velocity during the integration time of the detectors, then tiie filtered differenced 
signal corresponds to 

4Sij(F| . lAsWosA,p^x(F,ti]x(F,^)STFs(F,ti) • 

. _ urn _ ;i°'f_^i^T) j^^.;„f.^,)).e.p(.;niF.V(^)|]. 
H(MF = 0) + B(MF=0) nF-VjAT 



+ 



lAsWosAfpasx(F.ti)x(F.^)STFs|f ,ti) • 



L I H(MF = 0) + B(MF=0) nF'-VAT 

j h(mf = o) + b(mf = o) ttF-VAT J 



SpinAp spatial frequency and temporal frequency domain moving object detection will now be discussed. A simple 
mathematical representation of tiie spatial frequency and temporal frequency domain SpinAp moving object detection 
procedure is obtained by approximating tiie discrete tempaal sampling as a continuum and taking the continuous Fou- 
rier transform of tiie spatial frequency transform for each of tiie SpinAp individual frames. The Fourier spech'um of the 
noiseless individual frame measurements is given by 

Os(F,lj) = lAsWoA,p^STFs(F,tilBN(MJ ) 

* iAsW.A»sSTF(F,^) ., _ _ ^'^^f_'"'A .^.2nS. %)) 

H(MF = 0) + B(MF = 0) hF-VAT 

-UsWoAfpasSTF(F,tj). 

M^l d2F' jMP-Fl)WTo(i^) ^'°y:^^^)oxp(-2.iF. V.(t)). 
' H(MF = 0) + B(MF = 0) tiF-VAT 



The temporal Fourier transform of the spatial frequency spectrum of the individual frame is obtained by evaluating 
the integration, and applying the convolution theorem yielding 
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6s(F,f) = | dtexp(-27rift)6s(F.t) 
= lAsWoAfpasj dt exF(-27rift)STFs(F,t)SN(\ff ,t) 

= lAsWoAfpaS d{ SfFs(F,f)SN(jVff,f-f). 



where 

STFs 

is the temporal Fourier transform of the SpinAp system transfer function, and is the temporal and spatial frequency 
Fourier transforms of the normalized geometrically projected scene spectrum. 

Evaluating the temporal Fourier transform of the normalized geometrically projected scene spectrum, the noiseless 
temporal frequency transform of the strip aperture measurements, becomes 



6^,f)=lAsWoAfpaS- 
STFs(F,f)BNdc(M.F) + 

^ Atrg f^pa - jgw WM.F) ^'" y5^^^ Sn^s(F,f-F. V ) + 

A fpalHfpa + Bfpa) JCF- V AT 

Atrg fpaBfpa 



1 



fpa 



Afpa(Hfpa + Bfpa) 



TtF VAT 



The first equation above defining 6 s(F,tj) is used to determine the signal component of the temporal and spatial 
frequency matched filters. The matched filter essentially eliminates the temporally stationary components, since the 
first term of equation for ds(F,f) contains all temporally stationary effects and is zero for all nonzero spatial frequencies. 

Simplified signature's for uniform background, foreground, and nrraving object will now be discussed. Prediction of 
receiver operating characteristics for SpinAp moving object detection procedures can be simplified for the special case 
of obsen^tional scenarios associated with uniform intensity backgrounds, foregrounds, and moving objects. Indeed, 
the design of coarse moving object detection approaches may utilize such sinplifying assumptions. The temporally sta- 
tionary and spatially uniform components of the background and foreground can be expressed as, 



B(r,t) H Bo = BscN and H(r,t) = Hq = HscN 

where Bqcn 'S the average background intensity in scene coordinates, and Hscn 'S the average foreground intensity In 
scene coordinates. 

Focal plane average values and Fourier transforms will now be discussed. TTie geometrical projection of the aver- 
age values of the scene's background and foreground intensities are and 



19 



EP0 802 426 A2 




and the corresponding Fourier transforms are 



B(MF) = Bscn5(MF) 



-^Bscn5(F) = Bfpa5(F) 



H(MF) = Hscn5(MF) 



-i-H,en5(F) = Hfpa5(F) 



where use has been made of the Fourier transforms of the backgrounds in the scene coordinate system 



B(F) s Bo5(F) = Bscn5(F), and H(F,t) s Ho5(f) = 



and the Fourier transform similarity theaem. 

Zero spatial frequency relationships to mean values will now be discussed. The normalized geometrical projection 
of the scene spectrum is generated by dividing the Fourier transform of the geometrical projection of the scene by the 
zero spatial frequency component of the geometrically projected scene spectrum. The geometrically projected zero 
spatial frequency conrponent of the background's, and moving object's intensities can be expressed in terms of the spa- 
tially averaged mean values and the geometrical projected area of the backgrounds and object, as 



where Atrg fpa is the approximate instantaneous geometrically projected area of the moving object, Afp^ is the approxi- 
mate detected area of the background in the focal plane of the SpinAp sensor, and the overline symbol (— ) refers to a 
spatial average in the focal plane array. 

Zero spatial frequency relationships for the object inverse silhouette will now be discussed. Applying the Fourier 
transform definition to the object inverse silhouette in the scene coordinates, and transforming to the image plane coor- 
dinates by a change of variables given by Mr ^^^^ = R i^g^ , yields 



Therefore, the geometrical projection of the moving object's zero spatial frequency component can also be related 
to the object's effective area in the focal plane by 



Normalized spectra for constant faeground and background will now be discussed. Applying the preceding rela- 
tionships for the uniform background components of the scene enables determination of matiiematical expression for 
the normalized background and normalized object. Recognizing the ratio of tiie sum of background and foreground pro- 
jected scene spectra to their zero spatial frequency component to be 



TtMF=0,t) =TfpaAtPsfpa, B(MF=0,t) = BfpaAfpa, H(MF=0,t) = HfpaAfj 
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5 

yields the total normalized scene background given 



H(MF) + B(MF) ^ Hfpa + Bfpa5(F) ^ 5(f) 
H(Nff=0) + B(Nff=0) (H^^ + B^^Afpa Afpa 



BN(MF,t)sBN(Nff)«|^ 



1 



/ iN\ / ^^^^ / ^ ^ Atrg fpa(Tfpa - Bfpaj l 
\ Afpa(H^+B?^/ 

75 

In like nranner, the normalized object difference from the background, t n. ^or tenrporally stationary and spatially 
uniform backgrounds can be expressed as 



20 



25 



T(M.F.t) 



J A fpa(Hfpa + Bfpa) 



(xji^A ^ fpa(Hfpa + J A fpa(Hfpa + Bfpa 

ATNlM,F.tJ = j= = 

1 ^trg fpal ^ fpa " "fpai 

Afpa(Hfpa + Bfpa) 



Uniform object approximation will now be discussed. In scene coordinates, a uniform object can be represented as 
a product of the object's inverse silhouette, Wj, with the object's constant intensity level, Tq. i.e. 

30 

T(r.t) = ToWT(r.t). 
Therefore, the Fourier transform of a uniform object is 
35 T(F.t) = T3,„WT(F.t). 

and the corresponding geometrically projected transform of the uniform object is 

T(M.F.t) = T3,„WT(MF.t). 

40 

Thus, for uniform objects and backgrounds, the normalized object variation from the background. A t n. ^or tempo- 
rally stationary scenes is given by 



45 



pa(Hfpa-t-B^ M^J Afpa(Hfpa + Bfpa) ' 



AT.(MF..) = ^ 

1 + ^trg fpal-^ fpa " "fpa/ 
Afpa(Hfpa + Bfpa) 

50 r r r 
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(Tfpa - B fpa) Atrg fpa 

(Hfpa + Bfpa) Afpa I ^ Atrg fpa(Tfpa - Bfpa) \ 
\ A fpa(Hfpa + Bfpa) / 



where the normalized inverse silhouette is defined to be 

10 

WTO(MF=0,t) ^'rg fpa 

75 

and the zero spatial frequency component of the normalized Inverse silhouette Is 

WT{MF=0.t) = ^^. 



Applying the Fourier transform shift theorem to describe an object moving at constant velocity the object inverse 
25 silhouette is 

WTO(MF.t) = WTO(MF,to)exp(-27ciF- Vt) = WTOo(M,F)exp(-27ciF V t) 

30 where W-ris,(j(MF) = Wj,^(MF,to) is the normalized object's inverse silhouette's Fourier transform at time = to- "Die 
resulting expression for the object variation from the backgrounds is 

.^u,^A (T^ - B^ Atrg fpaWTOo(M,F)exp(-2jiiF- V t) 

A 1 nl^'^'W — / — V — I 1 7= ^ u • 

+ Bfpa) A fpa 

^trg fpaV ^ fpa " ^fpai I 
\ Afpa(fV + B^^/ 



40 

The differenced and filtered moving object spatial frequency signature for uniform objects and backgrounds ASy. 
is therefore 

45 ASij(F) = lAsWosAfpasZ{F.tiMF.tj)STFs(F.ti][SN(MF,ti) - StlMF,^ 

T W A n/TT > C.tT. . .c^rrr /tt > ^SUl (tIF- VAT) (T^ - 

= lAsWosAirg fpaX(F.ti)x(F.ij)STFs(F,ti) — ' 

tcFVAT (Hfpa + Bfpa 
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_. {exp(-2mF-V(tO) - exp(-2mF. V(tj))) 
'^trg fpayTfpa ~ Bfpa/ 

Afpa(Hfpa + B^^ 



The spatial domain differenced signal for uniform object, background, and foreground will now be discussed. 
Inverse Fourier transforming the moving object's differenced and filtered spatial frequency spectrum, produces the spa- 
tial domain moving object signature, which is 
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ASij(R) =1 d^F exp(-2KiFR )ASij(F) 

lAsWpsAtrg fpa (Tfpa ' Bfpa) 
^ ^ Atrg fpa(TfpaS " Bfpas) (Hfpa + Bfpa) 
Afpa(HfpaS + Bfpas) 

d'F.xp(-2«F.R-S(F..,te(F..,)STPs|F.., r''yf'^:^ 

JtF-VAT iHfpa + BfpaJ 

• WTOo(MF)(exp(-27riF- V (ti)) - exp(-27iiF- V(tj))) 



The differenced detector mean signal to RMS noise ratio will now be discussed. The mean differenced signal to 
RMS differenced noise ratio at location R for uniform objects and backgrounds can be expressed as 



SNRij(R) = 



TWA (TfpaS - Bfpas) 
iHfpaS + PfpaSj 



AdS XZ XZ g 2 L I Atrgfpa(TfpaS-Bfpas) 
* DjAxsDyAys \ Afpa(Hfpas + Bfpas) 

^ |d2Fexp{-27iiF-R)5c(F.tiMF.tj)STFs(F,ti)- I 



tcFVAT 



V |d2Fexp(-2:iiF- (R„ - R J ( 1 +|H{F,ti,tjl 'jx(F,tiMF,tj) 
where <...> denotes noise ensemble averaging, and the differenced noise variance 



may be obtained by analytic procedures described with reference to spatially white noise. 

Any differenced synthesized pair signal spectrum for uniform objects and backgrounds is now represented. The 
noise free spatial frequency domain signature for any pair of differenced synthesized Images associated with uniform 
objects and backgrounds is given by 
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n lv\ n IW\ n - ^afWqfA fppiF) Atfg fpa(Tfpas - Bfpas) 

NrAF) _ AfpalHfpaS + Bfpas) 

£ STFs(F.tj,) 

- S STFs(F,tO _ ^e xp(-27tiF Vfc(tic)) 
ic=i JiF VkAT I 

and the corresponding spatial domain moving object of any two differenced synthesized images Is 



I 



A0ba(r,5t) = I d^F OBA(F)exp (-2jciF-R } 

^ Afpa(HfpaS + Bfpas) 

I d^Fexpl-litiF R) f'^'F^^ Wtoo(MF) 

I n,^f) 

X STFs(F,tj,) 

■f' STFs(F,. r'f:V^'. xp(-2.rF.VX.,)) 

STF^F..> r'!l.^'^^l xp(.2.rF.V^.>)) 
k.l itFVkAT 

~ I^WqsA f ^^''g ^pat^^fpaS " fifpas) 
^ ^ ^ A fpa(HfpaS + Bfpas) 

d2p exp(2.iF .R-) si"UF V.AT) STF^F) . 
jiFVkAT nMf) 

X STFs(F.tj) 

I X STFs(F,tj)exp(-2j:iF Vj(tj)) JWtoo(MF) + 

X STFs(F.tk)exp(-27iiF Vk(tk)) Wtno(MF). 
1 k= 1 ' 



Matched fiKer nomenclature will now be discussed. The best possible performing detection processor, for wide 
classes of performance criteria, has been established to be an array of generalized matched filters with a comparison 
device, which will be referred to as a comparator. The design of the optimum matched filter arrays for SpinAp moving 
object detection processors requires incorporating knowledge of the unique signal measurement characteristics of the 
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SpinAp sensor, the desired data processing before input into the matched filter array, and the anticipated object phe- 
nomenology. The a priori object knowledge can be either statistical or deterministic in nature, including physical param- 
eters, such as, shape, size, velocity, acceleration, background to object contrast ratio, signal to noise ratio, number of 
objects, number of track crossings, noise cross-covariance, etc.. The matched filters of the an-ay for a particular signa- 
5 ture can be expressed in matrix notation as, 

F = SKl^^ 

10 where S is tiie a priori noiseless signal vector, and C nn is the noise cross-ccvariance mati'ix inverse. Both tiie signal 
and noise cross-covariance matrices are appropriately defined for the desired moving object detection data processing 
method. 

The signal matrix resulting from any of the combinations of differenced frames, differenced synthesized images, 
temporal frequency variations or other signatures as determined to be appropriate for SpinAp moving object detection 
15 may be represented as 

\ S(^n5ignai) i 

25 

where ^ refers to any or all combinations of independent spatial, spatial frequency, temporal, and temporal frequency 
signal coordinates associated witii the a priori statistical or deterministic SpinAp moving object signature. 

Likewise, the noise matrix resulting from any of the combinations of differenced frames, differenced synthesized 
30 Images, temporal frequency variations or other appropriate signatures as determined to be appropriate for SpinAp mov- 
ing object detection can be represented as 

N(^nsi,„J / 



20 



s = 



Si 

1 



35 



N = 



N 



N, 
N2 



The set of noisy measurements can therefore be represented in matrix notation as the sum of signal and noise 
components, yielding 



45 



50 



M = 



Mi 

Ml 



sK,) 



n(^i) 
4Q 



55 



Complex functioned matched filters can be constructed by recognizing the signal and noise matrix elements are 
the real and Imaginary parts (or amplitude and phase parts) of the complex signal and noise, respectively. 

For example, the signal and noise matrices for any number of differenced frames, or differenced synthesized 
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images within the spatially shifting matched filter acx|uisition "window" would be represented by 

/ ASi2(Ri) ^ 

AS,2(R2) 



s = 



/ s, 



ASi2(RnJ 

AS,3(Ri) 

AS,3(R2) 
ASi3(Rn,J 

ASap(Ri) 

ASap(R2) 
ASap(Rn.„) 



and 
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10 



IS 



20 



25 



30 



35 



N = 



I AN,2(Ri) 
AN,2(R2) 

ANi2(Rn«,) 
ASi3(Rt) 

ANi3(R2) 

AN,3(Rn„„) 

ANap{Rl) 
ANap(R2) 
AN„p(Rn_) 



respectively, where np^^ refers to the number of total elements in the spatial matched filter acquisition window. 

The matched filter output: The matched filter output therefore corresponds to the noise free matched fitter signal 
and additive Vhitened" noise, or 

Mout = FM = S'CN'N{S + N). 



N 



n$tgnil 



Matched fitter receiver operating characteristics for Gaussian noise will now be discussed. The receiver operating 
40 characteristics (ROC) for the SpinAp matched filter moving object detection processing methods utilizing a comparator 
and a threshold exceedence decision approach can be readily determined for approximately Gaussian individual frame 
measurement noise. The probability of detection and probability of false alarms for the SpinAp matched filter output for 
a given threshold can be determined from 



45 



Pdet = ||l + 



erl 



JflJL. 



2^ V2S'CnnS 



50 
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where In K is the threshold parameter of the oomparator, and 



erf 



InK 



2^ V2S'CnnS 



respectively 
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SpinAp differenced noise cross-covariance matrix elements will now be discussed. Determination of the noise opti- 
mal SpinAp moving object detection matched fitters depends upon a priori knowledge or assumptions concerning the 
noise processes and noise propagation from the measurement steps to the matched filter. The classes of SpinAp mov- 
ing object detection procedures described elsewhere in this disclosure utilize individual weighted frame differences, 
synthesized frame differences, or temporal and spatial frequency matched filters. The determination of the appropriate 
propagated noise cross-covariance matrix elemerrts is required to establish the noise optimal matched filters, or the 
performance of less than noise optimal techniques. The following sections provide example techniques for determining 
the appropriate SpinAp noise covariance matrix elements. Covariance matrix elements associated with processing 
steps not explicitly described can follow similar methods and procedures of determination. 

The noise spectrum for any pairwise differenced frames will now be discussed. One embodiment of the SpinAp 
moving object detection processing method differences any distinct pair of system transfer function equalized, and 
overlap passband filtered individual frames. The con'esponding differenced, equalized, and filtered noise spectrum, Ny. 
is 



The individual pixel noise associated with position H Is obtained by performing an inverse Fourier transform of the 
processed noise spectrum, and is 



For zero mean individual frame noise. ( ns(R»ti)> =0. ^ ns(R.tj)> =0 < nQ(F,t,)) =0. ( ns(F,tj)> =0.and 
<ANij(R)>=0=( ANy(F)>. 

The spatial noise cross-covariance will now be discussed. The spatial noise cross-covariance between any two 
pairs of differenced, equalized, and filtered frames at pixel locations Rm and Rn is 



where the super script * refers to complex conjugation. 

The effects of zero mean, temporally stationary and uncorrelated noise will now be discussed. For zero mean, tem- 
porally stationary, and temporally uncorrelated noise, the individual frame noise spectrum cross covariance is related 
to the noise power spectral density C nn l^y 



where 6j j and 6(F - F) are the Kronecker and Dirac delta functions, respectively 

Substituting individual frame noise spectrum cross covariance into the expression for the spatial differenced and 



ANij(F) s x(F.ii)x(F.tj)Hs(F,ti) - x(F,tiWF.tj)Hs(F.tj)H(F,tj,ti). 





|H(F,tj.ti)H'{.F',ti,tk)fis(F,tj)r^(F .tij + (nsiF.tiirslF .tj) - \ 
' l-H*(F,ti.tk)SJs(F.tj)rs(F\ti))-H{F,tj^ 

• x(F,tiEF,tjHF.tkK{F,t,) 



^s(F.tj)rs(F',ti)) = 5ijC„„(F)8(F-F), 
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10 



filtered noise covariance produces 

(ANij(R,„)ANki(R„))>=| d2F|.d2F'e-2pi(H Rm-F' Rn) • 

• { H(F.ti.tj)H'(F.t,.tk) 5j., + 5j.k - H*(F.ti.tj)5i., - H(F,tj.ti)6j.k ) 
• x(F.tiHF.tjgF.tkS(F.tl)c„„(F)5(F-F) 



20 



A special case corresponding to the pixel to pixel aoss-covariance for a single filtered and equalized frame differ- 
ence is obtained by letting the frame indices take the values i = k , j = I , and i ^ j. The corresponding effective noise 
15 spatial cross covariance is: 

(ANij(R>N,j{R„)> = 
I d2Fexp(-2jiiF- (R^ - R„))j 1 + 1 H(F,ti,tj)| ')x(F,tiHF.tj)C^ (F). 



25 Spatially white noise and Nyquist sampling will now be discussed. For spatially white noise, and Nyquist sampling 
of the optics passband the individual SpinAp frame noise power spectral density can be approximated as 

30 ^ DxAxsDyAys 

where X is the wavelength, Z is the effective optical system focal length. and Dy are the aperture sizes in the x and 
y directions, respectively. Axs and Ays are spatial sampling Increments, which for 100 % fill factor focal plane detector 
35 arrays conesponds to the detector spadng. and 

-> 

<7dS 

40 is the mean noise variance on an individual detector. Substituting individual white noise power spectral density aoss 
covariance into the expression for the spatial differenced and filtered noise covariance produces 

(AN,j(R„,)AN;,(R„)>= Ad? U \Z g [ d^Fe-^-^F- ^ - «■) • 
4 DxAxsDyAys J 



45 



50 



55 



■ jH(F.tj.ti)H*(F,t,,tk)^j., + 5i.k - H{F,luh) 5i.i - H(F,t,,ti) 5j.k) • 
z(F,tiK(F.tjHF,tkgF.t,). 



The special case corresponding to the pixel to pixel cross-covariance for a single filtered and equalized frame dif- 
ference is 



29 



EP0 802 426 A2 



(ANij(Rm)AN;,(R„))3 
M_XZ_^Z_^[ d2Fexp(-27tiF • {R„ - R„))( I -| H(F,tj.^)Hx(F.qHF.tj). 

70 Pi-wise differences and the covariance matrix elements and white noise will new be discussed. One further simpli- 
fying example, which for ideal system transfer functions has the processing advantage of not requiring system transfer 
function equalization, corresponds to differencing frames that are n radians apart. For an ideal rectangular strip aper- 
ture, the system transfer functions for two frames radians apart frames provide identical contrast performance, and 
therefore the equalization filter is exactly unity, or H(F,tj,t|):= 1 , and the overlap passbands are identical. Therefore for 

15 spatially white, and temporally uncorrelated noise, the cross covariance noise matrix elements are 

(ANij(R^)AN*k,(Ra))^CNNlij = 2a5s5ij 
or the covariance matrix can be represented by 

Cnn = 2adsl 



20 



25 



30 



40 



45 



where I is the identity matrix. The inverse of the cross covariance matrix is therefore 

r-* - 1 T 



dS 



The synthesized noise spectrum will now be discussed. Another embodiment of the SpinAp moving object detec- 
ts tion processing method differences any distinct pair of SpinAp synthesized images. As described in U.S. Patent No. 
5,243,351 , synthesized noise spectrum for the simplest form of synthesis process is 



Ssyn(F)=A(F) 



where the spatial frequency redundancy averaged noise n s ave(^' 9iven by 



Ssav.(F) = ^2ns(F.tj). 



TTie differenced synthesized noise spectrum will now be discussed. Given the synthesized noise spectrum, the 
50 noise spectrum, An synCH. for any pair (not necessarily derived from conrpletely distinct data sets) of synthesized 
images is 
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Ansyn{F) = AADs ave(F)- 

where Ans ave(F) is 

HKF) _ Nrf(F) _ 



70 



where the subscripts A and B refer to the SpinAp individual frame sets that were used to generate the synthesized 
images. 

Spatial domain differenced synthesized noise will now be discussed. Performing the inverse f=6urier transform of 
15 the differenced synthesized noise spectrum, generates the spatial domain synthesized noise at pixel location R, 

nsyn(R)= I d'Fnsyn(F)exp(27tiF.R)= d^F^s ave(F)A(F)exp(2niF • R ). 

20 ^ 

Spatial domain differenced synthesized noise covariance will now be discussed. The pixel to pixel cross-covariance 
for the synthesized noise difference can be expressed in terms of the SpinAp synthesizer and the cross covariance of 
25 the redundancy averaged differenced noise spectrum, or 

(ANsyn(R,n)AN;yn(Rn)) = 
30 (j d2FA(FPs ave(F)exp(27iiF R^lj d^FA (f avip )exp(-27tiF' • R„)^ 

= I d^Fj d^F'exp 27Ci(F • R„, - F" • Rn)A (f fe avefpfe avjF )j 
where the redundancy averaged differenced noise spectrum is 



4S 



k=l 

Nrt(F) 

1 



Z nsB(F,t,) nsA(F,tJ/, 

lNrf(F)j=i Nrf(F)ic=i )/ 
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10 



15 



Nrt(F) N^If) 

Nrt(F)Nrf(F)j=i 1=1 

Nrt(F) Nrtfp) 

pJ-T=\S Z teA(F.tk)s;A(F.tj) + 

Nri(F)Nri(F)k=i m=i 

Nrt(F) Nip) _ _ 

— ;=^T=tS S (nsB(F.tj)n*sA(F.tJ) + 
Nri(F)Nri(F)j=, ,=,_ 

Nrt(F) N«(f) 

- ,4 S I {Ssa(f. t,)jrs b(f . t,)) . 

Nri(F)Nrf(F)k=i m=i 



^ Zero mean, temporally stationary and uncorrelated noise will now be discussed. For zero mean, temporally station- 
ary, and temporally uncorrelated noise the individual frame noise spectrum cross ccvariance is related to the noise 
power spectral density C nn by 



fis(F, tj)n*s(F . ti)) = 5„,,Cnn(f)5(f - F ) 



where the individual frame times are displayed explicitly and accommodate the potential of synthesizing images based 
on sets of SpinAp individual frames that may possess common data. 
30 The differenced redundancy averaged noise spectrum correlation will now be discussed. For synthesized Images 
generated from distinct sets of SpinAp individual frames, the noise spectrum cross-covariance for differenced synthe- 
sized images is 
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(Ansave(F)Antave(F)} = 
/ Nrf(F) Nrf(F) Nrf(F) Nrf(F) \ 

Cnn(F)8(F-FK 1 I 5,, + -— L-^X I 5,,J 

lNrf(F)Nrf(F)j=i 1=1 Nrf(F)Nrf(F)ic=i m=i ) 

(Nrf(F) Nrf(F)| 

= — =H=:fnn(F)S(F -FK X + I =-^^(f)6(f -F) 
Nrf(F)Nrf(F) lj=i ic=i ) NrflF) 



Therefore, the pixel to pixel differenced synthesized noise for terrporally uncorrelated and stationary noise is 

(Ansyn(Rn,)Alhyn(R)) = 

I d^Fl d2Fexp[2Jii(F - F^R„)]a(f)aVM=tC„„(f)5(f - f) 
J ] Nrf(F) 

= d^Fexp [27ti F • (R„ - R„)]Cn„ (F) | A (F) | 
] NrflF ) 



and, for temporally uncorrelated. temporally stationary, and spatially white, the spatial differenced synthesized noise 
cross-covariance matrix is 



32 



EP0 802 426 A2 



(Ansy„(R„,)Aiuy„(R))= ( d2Fexp(2niF- (R„-R„))c„„(F)|A(Fj'-^ 
; Nrf(F) 

= ^ _^ 5^ e f d^Fexp (ini F • (R, - R„)l ^ \ '-2- . 
4 DxAsxDyAyx J Nrf(F) 

10 

Embodimeots of the present SpinAp moving object detection system consistent with a realization of the method 
illustrated in Figs. 2 and 3 have been reduced to practice and tested. Image data was generated using the embodiment 
of Fig. 2 to produce a noiseless differenced synthesized moving object signature and a corresponding template 
matched filter output. 

15 The image data demonstrated a low signal to noise ratio differenced synthesized image containing a faint smear of 
a moving object, and the output of the tenplate matched filter, thus demonstrating an excellent output signal to noise 
ratio on the order of 16 to 1. This demonstrates enhanced receiver operating characteristics that are produced using 
the present invention for this particular class of moving objects. In addition, experimental data has been obtained and 
used to demonstrate the n-wise moving object detection methods desaibed herein. 

20 Thus, Improved spinning strip (partial) aperture imaging radiometers that synthesize equivalent full circular aper- 
ture images and detect moving objects from a plurality of rotating strip aperture image measurements, or synthesized 
image measurements have been disclosed. It is to be understood that the described 

In summary, there is disclosed a spinning aperture imaging radiometer sensor system 10 and data processing 
methods 20 for detecting moving objects derived from a plurality of image frames acquired by a strip aperture Imaging 

25 sensor. A moving object in any invididual Image frame results In a motion smear signature in the total synthesized 
image. The motion smear signature is processed to detect the moving objects. One embodiment of the system com- 
prises a rotating strip aperture telescope 1 1 , a two dimensional detector array 1 7 that detects Images in the telescope's 
focal plane, a rotation compensation device 1 9 that prevents rotational smear during integration time of detectors of the 
array, a signal processor 18 that records a plurality of image frames of a scene imaged by the telescope as it rotates 

30 around its optical axis, and that Implements method(s) 20 for detecting the moving objects present in the recorded 
images. A hierarchy of moving object detection processors 18 and methods 20 Is disclosed that includes spatial, tem- 
poral, spatial frequency, and temporal frequency domain detection processors, and is compatible with multi-spectral 
background rejection techniques. Selection of the appropriate processing procedure and method depends upon the 
scenario, and the effective signal to noise ratio characteristics of the moving object. The present invention may be used 

35 for transient event detection. 

It Is to be understood that the described embodiments are merely illustrative of some of the many specific embod- 
iments which represent applications of the principles of the present Invention. Clearly, numerous ar>d varied other 
arrangements may be readily devised by those skilled in the art without departing from the scope of the invention. 

40 Claims 

1 . A spinning strip aperture radiometer sensor system (1 0) comprising a telescope (11) comprised of a rotating strip 
aperture that rotates around an optical axis and that produces temporally sequential images of a scene; 

45 a two dimensional detector aray (1 7) for detecting Images formed at the focal plane of the telescope; 

a signal processor (18) coupled to the detector array for recording a plurality of Image frames of the Image 
scene as the strip aperture rotates around the optical axis of the telescope, for synthesizing images from the 
plurality of image frames. 

characterized in that the signal processor (1 8) is adapted for detecting moving objects found in the synthesized 
50 images. 

2. TTie system (10) of daim 1, characterized in that the signal processor (18) processes at least two synthesized 
images (30) acquired by observing the same scene and detects moving objects found in the synthesized Images 
by: 

55 

differencing (40) ail possible distinct pairs of synthesized images (30); 
summing (35) the differenced images, and 

processing (50) the resulting differenced and summed data (45) through a matched filter array (55) and a com- 
parator (60) whereby a moving object detection Is declared when any outputs of the matched filter array (55) 
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exceed predetermined thresholds of the comparator. 

3. The system (10) of claim 2, characterized in that the signal processor (18) additionally spatially registers the syn- 
thesized images due to line of sight errors between measurement sets. 

5 

4. The system (10) of claim 1 , characterized In that the signal processor (18) processes at least two individual line of 
sight corrected frames (30-2) resulting from the observation of the same scene and detects moving objects found 
in the images by: 

10 filtering (31 -2) individual frames (30-2) using a system transfer function equalization filter; 

differencing (40-2) distinct pairs of equalized frames; 

filtering (41-2) the differenced data using a non-common passband rejection filter; 
summing (35-2) the filtered and differenced data to form a total summed spectrum of filtered differences; 
inverse transforming (42-2) the summed spectra to provide a OKiving object signature In the spatial domain; 
IS and 

processing the resulting summed data (45-2) through a matched filter an-ay (55-2) and comparator (60-2), 
whereby a moving object detection is declared when any outputs of the matched filter array (55-2) exceed pre- 
determined thresholds of the comparator. 

20 5, The system (1 0) of claim 1 , characterized In that the signal processor (18) processes a temporal sequence of the 
spatially registered Individual image frames (50-3) obtained by observations of the same scene and detects moving 
objects found in the images by: 

spatially Fourier transforming (51 -3) the spatially registered frames (50-3) to a common spatial frequency grid; 
25 temporally Fourier transforming (53-3) the spatially registered and Fourier transformed individual frame images 

(52-3) to produce a data set (54-3) associating all temporal frequencies with each spatial frequency; and 
processing (55-3) the temporal and spatial frequency transformed data set (54-3) using a noise optimal 
matched filter detection processor (55-3). 

30 6. The system (1 0) of claim 1 , characterized in that the signal processor (1 8) processes at least two individual line of 
sight corrected frames (30-4) resulting from the observation of the same scene and detects moving objects found 
in tiie Images by: 

filtering (31-4) individual frames (30-4) using a system transfer function equalization filter, 

35 differencing (40-4) distinct pairs of equalized frames; 

filtering (41-4) the differenced data using a non-common passband rejection filter; 
inverse transforming (42-4) the spectra to provide a moving object signature in tiie spatial domain; and 
processing (50-4) tiie resulting individual, equalized, common passband, differenced image data (45-4) 
tiirough a matched filter array (56-4) associated with the set of differenced data (45-4) and tiien a comparator 

40 (60-4), whereby a moving object detection is declared when any outputs of the matched filter array (56-4) 

exceed predetermined thresholds of the comparator. 

7. An object detection method (20) for use in an imaging system comprising a spinning strip aperture telescope (11) 
that rotates around an optical axis, a two-dimensional detector array (17) for detecting images located at a focal 

45 plane of the telescope (11), rotation compensation means (1 6. 1 9) for providing a stationary image during the inte- 
gration time of detectors of the detector array (17), and a signal processor (18) for processing the detected images, 
wherein the object detection method (20) comprises the following steps: 

recording a plurality of image frames of an image scene imaged by the telescope as the strip aperture rotates 
50 around the optical axis of the telescope; 

synthesizing images (30) from tiie plurality of recorded Image frames; 

characterized by detecting moving objects found in the synthesized Images (30). 

8. The object detection method (20) of claim 7, characterized In tiiat the step of detecting moving objects comprises 
55 the steps of: 

processing at least two syntiiesized images (30) acquired by observing the same scene; 
differencing (40) all possible distinct pairs of synthesized images; 
summing (35) the differenced images, and 
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processing (50) the resulting differenced and summed data (45) through a matched filter array (55) and then a 
comparator (60). whereby a moving object detection is declared when any outputs of the matched filter array 
(55) exceed predetermined thresholds of the comparator. 

9. The object detection method (20) of daim 7, characterized in that the step of detecting moving objects comprises 
the steps of: 

processing at least two individual line of sight corrected frames (30-2) resulting from the observation of the 
same scene; 

filtering (31-2) individual frames (30-2) using a system transfer function equalization filter; 
differencing (40-2) distinct pairs of equalized frames; 

filtering (41-2) the differenced data using a non-common passband rejection filter; 

summing (35-2) the filtered and differenced data to form a total summed spectrum of filtered differences; 

inverse transforming (42-2) the summed spectra to provide a moving object signature in tiie spatial domain; 

and 

processing (50-2) the resulting summed data (45-2) through a matched filter an-ay (55-2) and comparator (60- 
2). whereby a moving object detection is declared when any outputs of tiie matched filter array (55-2) exceed 
predetermined thresholds of the comparator. 

10. The object detection metiiod (20) of daim 7, characterized in tiiat the step of detecting moving objects comprises 
the steps of: 

processing at least two individual line of sight corrected frames (30-4) resulting from the observation of tiie 
same scene; 

filtering (31-4) individual frames (30-4) using a system transfer function equalization filter; 
differencing (40-4) distinct pairs of equalized frames; 

filtering (41-4) the differenced data using a non-common passband rejection filter; 

inverse transforming (42-4) the summed spectra to provide a moving object signature in tiie spatial domain; 

and 

processing (50-4) the resulting Individual, equalized, common passband. differenced image data (45-4) 
through a matched filter array (56-4) associated with the set of differenced data and then a conparator (60-4). 
whereby a moving object detection Is declared when any outputs of the matched filter array (56-4) exceed pre- 
determined thresholds of the comparator. 

11. The object detection method (20) of daim 7. characterized in tiiat the step of detecting moving objects comprises 
the steps of: 

processing a temporal sequence of the spatially registered individual image frames (50-3) obtained by the 
observations of ttie same scene; 

spatially Fourier transforming (51 -3) tiie spatially registered frames (50-3) to a common spatial frequency grid; 
temporally Fourier transforming (53-3) the spatially registered and Fourier transformed individual frame images 
(52-3) to produce a data set (54-3) associating all temporal frequences with each spatial frequency; and 
processing (55-3) tiie temporal and spatial frequency transformed data set (54-3) using a noise optimal 
matched filter detection processor. 
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